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This study assessed the construct ^aliditjf of a 
cognitive structure interpretation of maltidimensicnal scaling 
solutions of concept similarity data* Osing high school subjects, 
convergent validity was assessed through correspondence of scaling 
solutions of three similarity rating tasks; word asscciaticn, 
similarity lodgment, and semantic differential. Forther evidence tfas 
souqht by qroupinq subjects within each data gathering technique by 
similarity of response using, separately. Tucker's and Carroll's 
individual scaling techniques. Subgrotp lembership comparisons were 
made within data gathering techniques across scaling techtigiMS, and 
within scaling techniques across data gathering techniqnetl 
Characterization of subgroup members was attempted through several 
variables, including developmental level, fi€ld independence, 
coqni^ive complexity, and measures of ahility to cope with the 
-^^milarity tasks. On full group data, fit was excellent between word 
association and similarity judgment data, and poorer with semantic 
differential data. Judging by the fit among the in terpretabilit y of 
subqroup solutions, both individual scaling techniques formed groups 
successfully. There was considerable commonality of subgroup 
membership across similarity tasks in the Carroll analysis only. 
Characterization of subgroup members by the chosen variables was 
unsuccessful. Due tc error-full data, jcnly Carroll analysis and not 
Kruskal analysis produced interpret abl e dimensions on the subgroup 
data. (Author/PD) 
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ABSTRACT 

1 . f 



This study assessed*' the construct validity of a cogi:)ltlve structure 
Interpretation of multidimensional scaling 'solutions 6f concept similarity 
data. Usln^ high scho<M^ sub iects, convergent Validity was assessed through 
correspondence of scaling solutions of three similarity rating tasks; vord 
association, similarity iudgnicnt , and semantic^ differential. 

Further e\Adence was sought by grouping sub'jects Ifcithin each data 
gathering technique by similarity af response using, sepa/^ately , Tucker'gs^ 
arvl Carroll's individual scaling techniques.' Subgroup membership oomparlsons 
were made within data gathering t^chniques across scaling techniques, and 
within scaling techniques across d^a gatherlfi^ techniques. 

Characterization of subgroup members was attempted ttjrough several 
variables, Including developrental ^evel, field independence, cognitive 
complexity, and measures 6f^'t>ility to cope with the similarity tasks. 

On full group dati," fit was excellent between wo3;ti kssociatlon and 
similarity judgment data, ^nd poorer with semantic difiBfiiWitial data. 
Judging by the fit among apd'' irVterpretability of subg^up sdlutlons, both 
individual scaling techniques forned groups successfully. There was consid- 
erable coniiTonallty of subgroup membership across similarity tasks in the 
Carroll analysis only. Characteris^ati on of , subgroup members by the' chosen - 
varAbles was unsuccessful. Due 'to erro^'-full data, Carroll analysis onlj/^ 
and not Kruskal analysis produced interpretable dimensions «n the subgroup 
data . 
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Construct Validity of Cognitive Structures: 
a Comp^irison of XultidiRensiorjil yet hods 



IN'^HOIiUGTION 



The purpose of this investigation was to assess the validity of three 
wiaethods of uncovering "cognitive structures" from perceived interrelationships 
ar^iong a set of science concepts. The validation follows, in spirit,, that of 
Campbeiy ^nd ^iske (1^5^). Convergent validity was assessed by analysis 
of interrelationships produced by the same subjects on different similarity 
rating tasks, and by analysis of those produced by the^same subjects on the 
same similarity rating task but analysed by different' scaling mathods. Dis- 
criminant validity was assessed (only indirectly) through analysis of re la- 
tionships produced by different groups of subjects. These groups were formed 
using the individualized scaling models of Tucker and Kessick (I963) and 
Carroll and Chang (19f?0). Characterization of thf members of these groups 
was atternpted through a set of personality measures, some independent of 
and others dependent upon the scaling techniques. 

The construct validation may be viewed as a two-step process. The ■■ 

first step validates the methods of gathering similarity ratings^ through the 

I ' Is ■ 

establishment of the de^rree of-^corresponde.nce o^i^results across the.^ different 

1 >•'■•':, 

similarity rating tasks. The second step is the validation of the r^overed 

\ 

I, 

scaling* solutions, attenpting to establish them as representing ♦'cognitive 
structures", in that they represent some psychological reality for the ^uJ)jeA. 
This second step was attacked by two method's. First, scaling solutions wer^p 
analysed in terms^^^^/the meanings of the example concepts on which similarity 
data was gathered. S^^nd, thei personality measures of groups of subjet:ts \ 
who perceived the example conc^ts from different perspectives were analysed 
in an attempt to link personality ch^acteristics with these ^p4;^pectives. 



Sample ' ' 

The sample was a gfoup of 78 grade nine and 5^ grade twelve students 
In four- schools in Edmonton, Alberta. The sample originally chosen was 
considerably larger, but since* subjects were retained in the sample only if 
they completed six tests administered on three separate occasions, there was 
a large (50^) attrition rate. Since there was no, attempt in this study to 
generalize perceptions of science concepts to "typical" classes, for the 
purposes of investigating the data gathering and scaling ■ techniques only, 
the attrition rate was deemed acceptable. 
Tnstru.rentat ion 

■ T 

r 

The study used as exaTiple concepts a set of 15 syntactical (^s opposed 

to substantive) concepts within the domain of the scientific method A These 

v 

weret * ' v / 

conclusion dlsco/ery evidence 

experiment ^ explanation fact y 

hypothesis ' •imagination Interpretation^,. 
investigation law proof " 

, puzzle question theory 

' ^ /" . ^ • , 

F^ur matrices of similarity ratings among these 15 concepts were 

produced from the responses of each subject as follows: ^ 

r 

1) A constrained word association ^est was administered In which subjects were 
asked to respond continually, in writing for o|^ minute per concept, to each 
of the 15 concepts, the constraint being tha^ ithey were to "respond while 
thinking 'of the scientific meaning of the siftmulus word," Using the Garskof 
and Houston (I963) method with small nodif iJcation, relatedness Indices with 
values between 0;00 and 1.00 were calculated between all pairs of words based 
upon the overlap -of the lists of responses to each concept. Since the stimulus 
word itself is included in\he list, overlap can nover be perfect as the first 
two words can never be the same on boi;^h lists, A correction fac><ir was used 



by Garskof and Hour.ton to alloi\ a theoretical maxlnum of 1.00 if each word 
elicits the other, followed by identical lists of responses. This correction 
factor has the disadvantage of producing the same Index, 1.00, under-the \ 
described circumstances whether the list of Identical responses Is one or 
ten words long. Since It was felt t nat production of a longer list oT Iden- 
tlcal responses should Indicate a higher proximity of concepts In "concept 
space", the correction factor was not used In this study. Thus, longer 
Identical lists, had there been any (the highest relat^dness Index produced 
by any subjects was about 0.70)i would have produced slightly higher related^ 
ness Indices. The correctloh factor would have changed a typical Index 
from, for example, 0.^39 to OJU^. 

2) A second matrix of similarity data was also produced Y^om the association 
responses. There were very large between Individual differences In both 
fluency of response and average relatedness Index. The average relatedness 
Index Tiiay be taken as an Inverse Indicator of th^ size of the concept pool 
from which the subject responded.. Each subject's matrljf jwas renormed to a 
mean of 10.00 and a standard deviation of 2.00 to^ eliminate ^iff'e^^nces In 
fluency and averse relatedness Index. Without such renormlW, Individuals 
with the highest mean and standard devla;tion of related^s^indi^ps yould ha 
dominated any group average calculations. Howlver, since this ^fluenby factor 
may have been theoretically Important, data was analysed both>scaled (des- \^ 
cribed here) arrf. unsealed (described In (l^ above). 

3) A similarity judgment task (Torgerson, 1^158) was administered. In which 
subjects were asked to rate 105 possible pairs of concepts by making a mark 

on a line labelled "closely related-uyirelated** . Measurements fr 6m one end 

■ ' f'^ 

of the line produced a set of similarity ratings directly. These values w?re 
aJ.so rescaled to a mean of 10.00 and a standard deviation of 2.00 to remove 
patterns of response bias. Since such ^tterns were jiot bonslde^d theore- 



ve 



.tlc^lly Important, the data was analysed only In the rescaled form* 
^^U) A semantic differential scale (Osgood et al, 195?) cottsis^;ing of twelve 
patrs 0^ descriptors was used to rate each of the fifteen concepts. The 
results were analysed by first producing an Intercorrelatlon nvatrix for 
the ratings of the concepts based upon the patterns of' responsd(s produced, 

and then usin^ these intercorrelaticns as measures of slml Again/ to 

\ i. 

eliminate theoretically unimportant j^es^nse pat ternS,,, th^x matrices were 

renormed to a rhean of 10.00 and a standard deviation^ of 2.00/^ 

# ^\ ^ 

An att^s;ipt was made to characterise'' sub Xpts with a variety of 

\i \: 

personality measures, of potential theor-ii^^^l Importance. Three tests were 
used for this pur^aise: 

1) A test of developmental level wa6 comj^lle^^ from existing items, with some 
modifications (Karplus and Lavatelll, 1969>-MQi^biS , 19755'^ Time constraints 
limited the test to four items, whlc!^ were (a) conservations of volume; (b) 
co^abi nation of variables; (c) and (d) ^o coatrolli^i^^'arlables tasks; 

2) A published tes^ of field Indepe^iidence , the Hidden Figures^^T^t (French 
et al,. 1965) was administered; 

3) A test of co^n^lve complexity v^s designed, following the model of Seaman 

if 

and Koenlg (197^), but limited to a* six by six matrix. 

The above variables were deemed to be of theoretical Importance to the 
study, in that the three variables might reasonably be eXjjfected to play a role 
in explaining a person's method of relating concepts together in a "cognitive 
structure". During the course of the investigation, other variables were 
generated from the data which might have had explanatory power. For example, 
subjects varied>in ability to cope with the word association. Because of this 
the following variables were genei«Lted;^^^inber of responses, number and 
percent of responses which were original keywords, and personal consistency 
scores 6n each of the thre^e slnilarlty tasks (to be described below). 



Tradit^ oral' variables of sex, science gr^ade from the previous year, and 

I.Q. (f;rade nine only) were al^o investigated*. 

D€slf:n 

Each of the concept re-:latlonshlp tasks was paired, on the basis of 
len^t^, for administration with one of the personality tests. The pairings 
were: Hidden Flf^ares and similarity judgment, dqvelopmental level and woid 
association, and cognitive complexity and semantic differential. The person- 
ality test was always administered first. ' J 

V/ith three testing sessions needed per group, it was planned to test 
six classes at each grSide, each class receiving the sessions in one of the 
six poi^sib]e orders. Due to difficulty in finding grade twelve teachers 
willing to sacrifice three days to research in Apx*il of the graduating year, 
the original design could be followed in grade nine only. Only five classes 
were found for grade twelve, with one of the six orders of administration 
being's discarded* 
Analytig Techniques 

In each grade, four group ayerage similarity rating matrices were 
fonned on the basis of the four data sets. For brevity, these eight sets will 
be refenred to as: constrained association scaled (CAS9 and CAS12) and unsealed 
(CAU9 an^CAUl2), similarity judgment (SJ9 and SJl2)j and semantic differential 
(SD9 and SD12). An attempt was made to establish dimensionality of the 
solutions using the Kru^al sc4J.ing technique (196^, 196Ub) on each of the 
group average matrices. The "elbow" criterion was not useful, as would be 
expected on the basis df the behaviour of the stress function under error 
conditions (Wagenaar and Padmos, 19715 Isaac and Poor, 197^). On the basis 
of interpretablllty as much as stress^ all results are reported in three 
dimensions. Reasons for this will be discussed below. 

Comparisons between scaling solutions was done by the nonmetrlc 
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orthogonal Procrustes goodness-of-f it procedure (Schonemann and Carroll, 
1970; Llr^ccs and Schonemann, 197^). Rather than the measure of fit used In 
this technique, the more familiar Pearson correlation derived from it was 
reported. 

Each of the eicht sets of individual matrices was analysed by \oth 

\ 

the Tucker technique and the Can^oll. These techniques, group subjects \ 

\ 

i 

according to similarity of response matrices.* Subjects were grouped hy j 
their lo/vdin^s in ''person space*' within each grade. These subcroups we^^e 
then exarAred for ^inilarity wiYhin data gathering methods and across sWllng 
methods, arxi vice versa. Matrices within each subgroup were averaged, wi>th^^ 
the res\ilt analysed by the Kruskal techniq\ie. As explained below, subgroups 
were also analysed by the Carroll method. Attempts were made to interpret 
dimensions in terms of concept eanings, aixi to characterize members of the 
subeproupr> according to personality measures obtained. 



Reliability of T nstr^ar/^nts 

4 

The reliabilities of the instruments used were estimated in a variety 
of ways, ^ome^with recognized l^mitatior^s. A separate group of 18 grade nine 
students provided test'-retest (one month) data on the constrained association 
and cognitive complexity instruments. Repeated pages in the test booklets 
gave further correlational evidence of reliability of the similarity judgment 
and semantic di^ff erential instruments, while a similar technique in the con- 
strained association test gave an estimate in terms of the Garskof and Houston 
imex. These three cstinates are reported in Table 1 as personal consistencies. 
Reliability for the developmental level test was estimated by KR-20, and the 
Hidden Figures test by split halves. The cognitive complexity test was 
dropped due to low reliability. Reliabilities are summarized in Tab]e 1. 
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Table 1 abojt here 

Group Avera^G rps,u]ts 

KniGkal r.caling wa.s perforFiod on the ^oup average matrices. The 
stresr> 1 values for two to cix dimensional solutions are reported in Table 2, 
Althou^-;h the "elbow" criterion is not entirely appropriate, it would seem 
to indicate that CAS9, SJ9, and SD12 rr-quire three dimensions, CAU12, CA512, 
and SD^> fouri an'i offer no clear decision for the remaining two cases. 

Table 2 about here 

A decision wars made to report only trfree dimensional solutions for 
the followin^^ reasons. First, according to Isaac and Poor (197^), the strer.s 
value?; for all ei^rht cases would be acceptable for a ^0^ error situation, 
which is reasoaable in light of the reliabilities. Second, based on pilot 
work, three dinenslons would be easier to - interpret than four. Third, since 
comparisons between sut^oups are to be rade, su^^oups might be expected to 
require fewer dimensions due to their homogeneity. Fourth (in retrospect), 
Carroll analysis shoved no significant improvement in correlation with the 
orig^inal data in moving from three to four dimensions. 

Due to the bulky nature of the data in this study, comprising over 100 
pages of tables, only exp.mple results are reported here. Results given are 
representative of those omitted. Complete results are available from the 
author*"on request- ^ 

Table 3 contains sample scaling solutions for the data. Since di- 
mensions in Kniskal analysis are arbitrary, all solutions are reported 
rotated to a common target, arbitrarily chosen as the SJ9 results. 

Table 3 about here 
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Althou-'^h It was no* a focus of this study, attempts were made to 
intorpr»'t dlr^^nr.! c>ris of th<*se rotat^^d solutioni^ Th*/ labels chosen were 

f 

••ccj'laLnty'', •'creativity", "theoretica 1- practical** , and **temporal". Subtle 
and arbitiary dU^t 1 not! cnr> wore made In order to create distinguishable labc 
For oxa^.ple, hir,h loadin,?; of the concept ••conclur>l on** indicated a •'temporal" 
rathor than a "certainty" dimension. When •'theory*' or "law** was opposed to 
"concV:r>ion" or ''fact", a "theoret ical^practical" "dimension was named* A 
raip.rr.arv of i:>u'j\\ interpretations is given in Table In general, the .first 
two di.T.ensionr-. of all solutlnns are labelled the tiame. This consistency' ? s 
interpreted ar> c.^nverz-^ent validity evidence. It should be noted that the 
ser^antic differential solutions required the most stretching of the dimensio 
naming convention 

Table 4 about here 

Tciblf- ^3 re^jrls furllier evidcr^ce of convcrcont validity in the forn^.^ 
of goo^in^r.s-cf-f 5 1 rr.easurcs of the scaling results. The table also reports 
on the effect of scalin^-r the association n^atrices for fluency difference^,, 
and the difference between the two grades. In general, the association data 
and siinilarity .iud^nent data fit each other better than either fits the se- 
mantic differential data. Between grade differences may be interpreted as 
discrininant validity, but the nunerical evidence is weak, even granted that 
there is no estimate of how nuch difference three years exposure to science 
should r.ake. <\ ^ 

Table 5 about here 

Tucker Scalin.'^ Results 

Table 6 presents the unrotat^d factor loadings for the first six 

factors for each data set. Since the first factor is a nean factor in data 

i > 

sets 3 to a, due to the initial Homing, percentage loadings of all but the 



first factor arc exprcr:>cd a^; percentages of variance left after the first 
factc^r Is taken nut. This explalfms porcer^tages totalling, more than 100'^. 

^ « )f # M- * M -It « # « • ^ « V « # 

Table 6 about here 

Since each factor r^^talned would form a ^oup, and scree tests were 
of no help, jt was arbitrarily decided to retain four factors (factors 2 to 
5 for data sets 3 to ^) for varlmax rotatl(Mi. After rotation, subjects were 
group'^d accordln,3 to their »hlc;hest loidln^^ with the following exceptions; 
those If^adln^ ^eater than 1-00 on more than one factor; those loading less 
than 0,30 on all fact-ors; r.nd those whose hl^^hest loading was less than I.5O 
times their next hifhest were all elinlnated. In this ranner, an average of 
6lf> of the subjects were placed In four groups within each data set in a 
mutually exclusive but not exhaustive nanner. As there were no commonalities 
of group membership, these memberships are not reproduced here. Had there 
been commorictli t> , this would have prts^-n'.ed cor.rpol*Liri^^ evidence for ccnvcrGer.t 
validity of the scaling solutions 

' Table 7 ^Ives stress values for the Kruskal analyses of these subgroup 
average matrices. Since those retained in groups would be expected to have 
produced more homogeneous and less error-prone data than those omitted, stress 
values should have been lower than in Table 2. That this was not so roust be 
due to higher error in the average data of the smaller group, as will be 
dlsc::ssed below. 

Table 7 about here 

Table P reports goodness-of-f it correlations among a full group solu- 
tion and the four corresponding subgroup solutions. Although the Tucker 
technique has identified sub.'Troups with different perceptions, a search of 
the ^6 dinensior^s produced fo'ur.d only the occasidtial interpre table dixen:vion. 



10 

This point wHl also be returned to. 

Table 8 about here 

Due to dl f:1.cn'ltios in r.atr i x' i nyerr,ion dae to m-^ r redundancy of 
variables, th.t? personaiity rr.easuro.s could not be i-nvestic^'^-ted by the approp- 
r'.ate tecfUiiiq'.:'.- , ^♦rit Ivariatr analysis of varianc-i. an alternative, one« 

way Anova at + ho 0. Oi ^ vt l was cho' '..•n. Nine oi the ll6 analyses of variance 
werK' sip;ail'-- rcvnt , and I'Vi reported in Table 9- As can be seen, only the 

interr.allv r/::. -rated variables produced significant results. It is of interes 

> 

that fluency ^nrn^l a Laris for t^o\ipin.T in tlie unsealed ar.sociaticn data 
which did not ir^rsist \ :\ the scaled data, despite the hi^n correlation between 
the overall ^;roup results in the two cases. The rescalin{^, therefore, did 
prevent the fornation of a fTT'^up on the basis of fluency. 

Table 0 about her- 

Ther'^ a:-t: r^-veral poss' blc reasons for the ^ack of interp'retabili ty 
of th.e suc-:r:i:p soluiLor.s. r^lrst, error in the data Tiay have confouiided the 
results. Cr, if perceptions were constrained by the "right answers", subjects 
close to the grrcup avcrar^e may have loaded^^jcrff^everal dinensions, and been 
eliminated by the groupin^t criteria. Thus, those grouped night be those who 
deviate subr tant ially frox the group average, and who might have the nost 
error-prone data. Since the Kruskal technique seems unable to operate in the 
presence of high error J^els, perhaps the Wagenaar and Fadmos criteria for 
acceptable stress are too lenient. 

If the Tucker technique has failed, then the personality results are 
"to be Expected. If not however, then we niay have chosen the wrong variables, 
meas'^ired them inaccurately, or they ray be irrelevant to concept perception. 
The Carroll scaling results will shed light cn these possibilities. 
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Carroll !^ call resnlts 

Carroll scalinjr tl-.e full prcup data sctr> was done both from a 
random nui^.bcr start and a Txivskal c^oup solution start. Since, cort^elation 
was 0.09 between the two, only the forr.cr is reported. Table 10 reports 
the fit of the c:arroll f;roup avera^^e re.cult to the Kruskal result and to 
the orif!;lnal data. perfect fit was not expected between the Kruskal and 
Carroll re^uli:;, ai.. the 5^crr:';;r weip/r.i:; all subjcctr. equally, while the latter 
gives more welrht ^o th^'se closer to the (];roup avero.ge . 

Table 10 about here 
^ *K*->*^** * 

in support of th.e reporting. of i*esults :'. hree dimensions rather 
than four, aver^-^fo correlation of Carroll results with data, 0,58 in three 
diir.ensinns , ro.oe to only 0.6/! in four. 

Rather than producing; subg^roup solutions by weighted coinposites of 
the C'-rroll I'Z^^-i- \- :z , ar.i^vo*^ rrocood'~-d in a r.anner analc^ou^j to the Tuc-'or 
r.eth^:-d. r'ollcvlr^^ s':t,^cu]^ forRation, the sub.^oup average matrices were 
analysed by the -"ruskal tecrnlnue. Since the subiect dlmen^j^.s In Carroll 
analysis direr-tly reflect tlie inpcrtance of corresponding dimensions in 
concept space, the (proup forr.ation criteria differed from the Tucker analysis. 
For ^rade nine, the ten htrhest of 7R (grade twelve, eight of 5^) loadings 
were used to fcrni each of the three groups. This procedure placed ^Ifo of 
subjects in three 5roups, which Is of the same order of magnitude as the 61,"? 
in four groups of the Tucker analysis. The Carroll groups were not mutually 
exclusive. « 

Since there is substantial cor.T.onality , group membership Is sumr.arired 
In Table 11. With the exception of two pairs of subjects, g^rouplng is the 
sar.e in all sub.3rou^)s of C\\^9 and CtS9, and in CAU12 and CAS12. CA119 group 
one am SJ9 group three have six members In common. Overlap can also be seen 
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between SJ^^ tToup two and both C.V;9 and CAo9 F,roups one and two, SD^ G^^oup 
one ani 3"*'^ group throe-, C/''12 {rroui: one and GJ12 {^oup one, a^nd CA312 gtoup 
three .and ^oup In contrast to the Tucker results, these results 

offc-r strr^r^^, evidence both for the constr'.ict validity of the cognitive struc- 
tures uncov'c'n-'d, and f c r the power of the Carroll technique In error-full data. 

Tabic 11 about here 

The subfToup av*'^rar:e matrices produced were analysed by iihe Kruskal 
techniq'je. "-^ress values were high, similar to those for tiie Tucker analyses. 
Measures of fit ainon^ the subgroup solutions and with the corresponding full 
croup are reported in '^able 12. Average fit was O.UR, slightly better than 
the in the Tucker case. 

Table 12 about here 

Atte:'.vt£ to la:^i dirie prions were l^r?;ely fruitless, as with the ^ucker 
results. Th*^ wrsonality r.easure: a^ain had no explanatory power. Despite 
the teri^tation to conclude that neither individual technique was operating 
as desired under these circumstances, one bit of evidence prompted further \^ 
investigation. Those sub^iects Included in subgroups by the Carroll scaling 
had a higher correlation of the solution with their original data, 0.68, 
than did the full group, at O.58. That is, the Carroll technique was 
successfully isolating those nearer the group average, and was not operating 
on rand on error. 

This fact prompted further investigation of both the Tucker subgroup 
data and the Carroll subgroup data using the Carroll technique in pl^^ce^f 
the i^lruskal technique. As can be seen from Table I3, about 75^ 0/ the 
isolated dimensions can be assigned neaning on the basis of the criteria used 
in attempting a similar naming for the corresponding Kruskal solutions. In 



ERIC 



13 

Table 1^, correlation:: L^ttvccn Ihe CarroU r.oluticns and the jorresppndlng 
l-jnjskal r^olMtir>ns shew that tno two ^-rer.ults bear "ilttle resomblanoe to one 
another. Cn this evidence:, it seems clear that the Tucker and Carroll 
techr.lq^..r, are r.rcu}ir^: on serf* real bat unidentified i ndividualM If f ere net r. . 

Tables 13 and 1^ abc^t here 

The r,^ ^^n'-.^ 5.:^ f-f It resiults anonr; the Carroll solutions of the 

Tucker c.ulrrow: ar/i correspoii<li ng full ^'oap are reported In Table 15# alone: 

with the sn'-.e recMits for th.e Carroll groups. There Is a reasonable balance 

between no individual differences (r = l.CO) and differences so extreme (ar. 

in Tables an.1 12) that the results mtf^||be suspect. For tl:e purposes of 

addressing the hypr-theses of this study^J^^ possibility of labelling the 

diT.enricns of the suV'Troup solutions, and the Isolation of real differences 

in c 'n'-epi perception offer evidence for the validity of a cognitive structDro 

i r terv^^^ *-at ' on of : r.:i vi.nual scaiin; solutions. C():..:;cr::bLli ty of sub^s^'<jup 

mornbersh^p across d-^ta f:atherirui techniques within the Carroll analysis, hut 

not wit": in the Tucr.or analysis, is evidence that the Carroll technique Is 

more robust with respect to error than is the Tucker technique. 

Table 15 about here 

The purpose of this study was to seek conver{^ent validity of a cognitive 
str\icture Interpretation of multidinienslonal scaling solutions of concept 
similarity data. Three data acquisition techniques and two analytic techniques 
for subject grouping were used. Various personality measures were used unsuc- 
cessfully to cnaracterlze nenbers of subgroups. There was comr.onality of 
subgroup nembershlp within the Carroll analysis, but not within the Tucker 
analysis. Cn subc-prrup data, the Kjruskal technique gave uninterpretable 
loadings In concept space. Similar analysis by the Carroll technique, however, 
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1^ 

f;av* interrretabie direru^ions. On trie grouv average data, convergence of 

/ 

/^foncept slr.:l'irity dr^ta v:an {^cod< This ccnverr;ence was taken as evidence 
for the cc;:nitivje structure interpretation cf nultidimeus i orAl scaling 
solut'jlonn on concept s5rrl]arlty data. 



4 
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TABLE 1 

SUMMARY OF RSLTABTLITY ESTIMATES 



To o i 


"etnod 

^ k 


Grade -9 


Gfade 12 


CAU 


Test-retest (data) 


0. 76 




CAS 


Test -re test /data^ 


0.76^ 




CA'J 


Test-retest (soln) 


0.70 


i 


CAS 


Tesi-retest (soln) 


0.53 






5^ersonal consistency 


0.46 


0.^42 


SJ 


Personal consistency 


0.56 


0.51 


SD 


Persmiirl consistency 


0.60 


0.64 


» Dev. 


Lev. 


0.45 


0.50 , 


\yHid. 


Fig. Split halves 


0.77 


0.78 ^ 




Com. Test-retest 


-0.11 





TABLE 2 





STRFSS 1 V,'uVJES FOR 
AVL'RAG? KHUSK.il J 


FULL GHC'!p 

>oi;;ttcns 










6 


Dimenc 
5 4 


ion 

3 


2 


Data Set 


1. 


CA'r9 


4.8 


5.0 




8.1 


11.4 


2. 


CAni2 


^.9 


5.0 


5.6 


10.2 


13.4 


3. 


CAS9 


4.8 


5.0 


5.0 


6.2 


14.0 


4. 


CAS12 


5.0 


5.0 


6.1 


10.8 


15.8 


5. 


SJ9 


5.0 


5.0 


5.0 


6.1 


14.1 


6. 


SJ12 




'K9 


5.1 


7.8 


15-5 


7. 


SD9 


4 7 


4.8, 


5.0 


12.7 


16.7 


8. 


SD12 


^^.9 


4.9 


^^•9 


6.2 


11.9 
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EXAMPLE KR"::? 
DATA RC: 



TABLE 3 

• C^C)"^ T l-VT -wye 



CP rTJLL GJ^OUP 
-TARGET 




Dimensi ons 



Concepts CAl^9 data 



Cone 


-0. 0? 


0. 07 


Diso 


0. 10 


-0.26 


Kvid 


-0.23 


-0. 21 




0. 19 


-0. 10 


Sxpl 


-0.09 


0. 12 


F'act 


-0. 32 


-0. la 


Hypo 


0. 1? 


0.2';^ 




0.07 


0.22! 


Into 


-0.03 


0.35^ 


I nve 


0.20 


-0.1& 


L-1W 


-O.UO 


-0*3^ 


Proo 


-0.23 


-0. 22 


Pvc-z 


0. 50 


0.15 


Ques 


0.28 


0. 16 


ThCo 


-0. 09 


0. 12 




TABLE U 

S"''"-'ARY 0:^ D-Kl'NTICN I>rrP:RPR5T ATTGKS FOR KHU3KAL 
SOL.nTICNS 0?^ PTILL G?CUPt)ArA ^ 

> " 1 



Data Se^t 


Dimension 




1 2 






;j 




CAU9 


1 2 


ii 


C All 12 


1 2 


0 


CAS9 


1 2 


3 


CAS12 


1 2 






1 ■ 


1 


SJ12 


1 k 


3 


SD9 


1 2 


0 


SD12 


1 3 


0 



\ 



0 - No cljsar interpretation./ 1 - Certiiinty; 2 - Creativity; 
3 • Theoretical-practical; A - Temporal 

20 



f ■ » 

OF pJll gh'j"-'}' av;-:rag2 data 



Routed '•'::itrix 



Conver nt Va 1 ] i i t^- 



:arcet r'atrix 



CAS9 
CAS 9 



SJ9 
SD9 

SD9 



0.91 
0.62 
0.64 



CAGia 
CAS 12 
SJ12 



SJi2 
SD12 
SD12 



0.89 
0.76 
0.76 



F:ffoct of Scalinr 



CA'Q 
CA"12 



CAS9 
CAS12 



0.9^ 
0.97 



Gradp Dlffercncer. 



CAC9 • 

SJ9 
SD9 



CA312 
SJ12 
D12 



0.78 
0.92 
0.70 



tabu: 6 

un:<c^at:-:d Tucrr-^-i factcrtng-fhhgfntagk total variance 

ACCO'i'frrED FOR '3Y FIRST SIX FACTORS 
FOR EACH DATA S'^T SSPARATi^LY 





4. 


2 


Factors 
3 ^ 


5 


6 


Data Sot 














CA'J9 


55.5 


5.8 


3.1 


2.8 


2.5 


2.4 


CAU12 


62.7 


5.1 


3.3 


Z.k 


2.3 


2.2 


CAS^ 


07. 2 


«. 0 




6.2 


5.3 


4.8 


CAS 12 


97-1 


8.2 


6.6 


6.5 


5-9 


5.8 


SJ9 


97.3 


7.9 


6.1 


5.2 


4.4 


4.0 


SJ12 


97.2 


7.6 


5-5 




5.0 


^.5 


SD9 


96.5 


7.8 


6.3 


5.6 


5.3 


^.5 


SD12 


96.6 


9.3 


P. 8 


7.^+ 


5-7 


5.5 



For data sets 3-8, percentages calculated excluding first factor. 
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TABLE 7 

STPKSS VALUr:S FOR KIV^ZK'L ^yAllVZ 

TucKf^R ri'}^,pr''p /.:,'?.?. ~.Zt: vatrickg 



Dlir.ension 



Group 


6 




5 


k 




3 


2 


1 


10.7 


13 


■5 


16.5 


21 


.9 


31.0 


2 


11.3 


12 


• 5 


15.9 


21 


.4 


29.6 


3 


10.8 


13 


.2 


17.2 


22, 


.5 


30. 1 


4 


10.5 


13 


. 1 


16.4 


21, 


.9 


30.9 



tablp: 8 

GCODN-:C3-0?-y':T AVONG TUGKFH SUBGHOU? solutions ANT) WITH 
R?:SPi:CTTVK FULL GROUr SOLUTIONS (EXAXPir ^ SJ12) 



Full Group Sub^p. 1 Cub^p, 2 SubgrpO 

Subf:rp. r 

Sub^.2 O.IB 0.39 

Subn:rp.3 0,15 O.56 0.49 

Suh[;rp./| 0.26 0.^9 0.^9 O.55 



TABLK 9 

SlGNr.^'^^CANT PKr^i'ITl' 0? Ai:C VA - PEHSCNAL^TY 



VARTABLr:S A^'ONG TUGK^-R r:3GR0:]FS 




variable CAVJO CAS9 „ CAU12 



(on asf^oclatl on tar,k) 


F 


P 


F 


P 


F 


P 


Total Pcsprnses 

Tot.'il internal Kej'vord Responses 
Frartion Int. Keyword Responses 
Avp;. [{elatedness Tnd"x 


5.2 
6.7 
4.5 
16.6 


. 009 
. 001 
. OOR 
<. 001 


4.4 
3.9 
5.2 


.001 
.016 
.004 


1R.2 
10.4 
12.9 


<> . 001 
<. 001 
<.001 



df error: CAUQ - ^3; CAS9 - 38; CAU12 - 32. 
4 



22 
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TA>>:'': 10 



;;oi'!rTc:;:., amj l;a" a for ^'.a:. g-cjic 



Data Set 


Carroll-iTi.'.kL:! r 


Carrv-^ll-Data r 




0,70 


0, 60 




0.75 


0, 5° 


c: 


0. 


O.^^O 




C.74 


0.58 




0.95 


0.6'i 




O.F'-' 


0. 59 




O.Pl 


0.50 




O.Q-^ 


0.51 



TAPI.r: 11 



Data Set Subject TD's 







1 


3 


,10 


25. 


35, 3« 


41 


42, 


61,62,64 




Gro\jp 


? 


2 


0 


13. 


17.27 


40, 




54,57,! 0 




Grou p 




2 






'^,33. 


37, 


43, 


40,53,63 






\ 


1 1 




2.'i, 


; ^'4 






'-,.'1 




Group 








2''-, 


3l!4'^ 


h'-. 


"/, 






Gro'jr' 


3 


Q 


13, 




1^^,24, 


-) . ■ 
i. ' 


4.S 


50 


GASO 


Gro'ni 


1 


? 




Q 


0,12, 


37, 


'^3, 


40,53,^.3 




Gro-n 


? 


?. 






35,3". 




'•2, 


61,62,64 




GroMp 


3 


2 






17,27, 




44 , 


54,57.60 


r:ASl2 


Group 


1 


1 1 


17. 


24, 


27,34, 




40, 


';4 




Group 


2 


11 


12, 


17. 


l^-,26. 




47, 






Group 




^. 


13, 


14, 


19,24, 




45, 


50 




Grf>np 


1 


P, 




5,31,33,43,40,' 


•7.63.78 




Grcaip 




2, 


3, 


12, 


13,25, 


32 


40, 


44,61,62 




Group 


3 


21, 


27, 


y\ 


39,40, 




65. 


66,71.76 




Group 


1 






17, 


21,31, 


3^. 


49, 


';4 




Crou p 




5, 


1 q, 


22, 


25,20, 




4^, 


45 




'Group 


3 


1, 


?, 


R, 


12,15. 




32, 


44 


SD9 


Gr(;f,rp 


1 


B. 


2U, 


26, 


41,45, 




5^\ 


65.66,76 




Grf,up 


0 




12, 




18,27. 


^ ■ ' 1 


49, 


67,72.75 




Gr^up 


3 


7. 


1'^ 


15, 


17,20, 


51, 


61, 


64,-71,7.'* 




Gr(i)|:ip 


1 


11 . 


21, 


22, 


3^,40, 


41, 


''2, 


54 




Groi\T> 


^_ 




10, 


17, 


2°, 45, 


46, 


47, 


50 




Group 


3 


li 


15, 


20, 


21,26, 


31. 


34, 


52 



23 





























Pull Grru] 


. Subf-rp. 1 
















0.2'^ 
















SubtCrp. 2 


0, 2h 


0.51 














Snbgrp.3 


0.22 


0.41 




0.49 
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T N 




'ON' 3 Ci' 


7^::S1(~^N3 IN 


c . 


■'.r^rOLL 










SCL'JT^i 




?. R S'jBGRO'JI 














Grade 9 








Grade 


12 


Data .>^t 




Din. 


1 Dir.. 2 


Dir. 3 


Dim. 


-7— 

I 






CA'J Group 


1 


1 


2 


3 


2 






0 




2 


2 


0 


3 


1 




0 


0 




3 




2 


3 


1 




0 


0 






1 


U 


0 


1 




0 


0 


CAS (7rrup> 


4 

1 


1 


3 


2 


u 




U 


0 

c 




2 


1 


3 


0 


1 




3 


0 




3 


1 


3 


0 


2 




0 


3 






U 


1 


3 






1 


2 


SJ Group 


1 


k 


1 


3 






0 


0 




2 


2 


3 


1 


1 




3 






3 


1 


k 


3 






0 


2 




U 


U 


1 


2 


1 




2 




SD Group 


1 


1 


0 


3 


0 




1 


0 




2 


1 


k 


0 


1 




3 


3 




3 


? 


k 


0 






3 


0 




4 


1 


u 


0 


1 




0 


0 



0 - nr cle-.r ! ntt^rpretat i on; 1 - certainty; 2 - creativity; 
3 - theoretical-practical; h - temporal 
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Group 1 Crcup 2 Cr-vjp 3 Gr^^ur 













Q 


































G A- 


0. 


op 


0. 




0.21 


0. 


U; 




0. 


ID 


0. 


17 


0. i'J 


0. 


1''4 


S.I 


0. 


16 


0. 


10 


0. iU 


0. 


27 


■ 


0. 


lu 


0. 


17 


0. 1 1 


0. 


I'l 










Grad" 


12 






C A' : 


,0. 


ko 


0. 


32 


0.13 


0. 


21 


ca:- 


0. 


19 


0. 


?3 


0. 23 


0. 


1^ 




0. 


?0 


0. 


IP 


0. IS 


0. 


in 




0. 


16 


0. 


25 


0.26 


0. 


OB 



1 uckor 



\i>;,'rroup 1 0.?*> 

uhrroup ? 0.?? O.S(^^ 



,1 .>rrr"^^p 



0.H2 0.62 0.h\ 0.(A 

Cai-T^o) 1 



Gub^oup ? 0.7 3 0.^;0 

Gub.'rroup 3 0.79 0.6k 0.59 



